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Two types of student response inventories for 
appraising instruction, the Student Instruction Report (SIR) and the 
Inventory of Student Perceptions of Instruction (ISPI) were 
administered to 554 students in 30 classes at two Georgia colleges. 
Mean responses to items were used in principal components analyses 
with varimax rotation. The two instruments were then administered to 
525 students in 31 English classes having a common final examination. 
Results of multiple regression analyses produced a significant 
multiple correlation with one instrument and self-reported cumulative 
grade point averages, with end-of-course grades in English as the 
criterion variable. Results of this study suggest that student 
appraisal of college instruction using SIR in conjunction with 
self^-reported grade point averages are of some help in predicting 
end-of-course final examination scores. If the effectiveness of an 
instructor is measured in terms of end-of-course achievement of his 
class, then college administrators should proceed with caution in 
using student ratings to gauge instructor effectiveness. Moreover, 
results of this study lend some support to the use of instruments 
developed empirically over those developed rationally. (Author/BW) 
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Many faculty members criticize the use of student rating forms. However, 
after a review of the empirical studies pertinent to these criticisms, Costin, 
Greeaough, and ilenges (1971) concluded that the ratings can provide reliable 
and valid information on the quality of courses and instruction. They further 
pointed out that "faculty resistance to the use of student rating forms may 
stem partially from the fact that many rating forms have been prepared by 
groups or individuals not qualified to construct such instruments" (p* 511). 
This claim seems founded* Miller (1972) stressed, "Too many procedures for 
evaluation consider only the first step, the development of evaluative 
criteria." (p. 15) 

While a review of the literature revealed the widespread use of student 
evaluation instruments, little information about the genesis of the instru- 
ments was given. Further, rresearchers who have studied student ratings have 
ganerally been vague about the characteristics of the instruments they chose 
to study and the reasons for those choices. Since college instruction is an 
important aspect of our society and student rating of instruction is a common 
practice, research pertaining to the instriiments used is very worthwhile. 

Considering all of the checklists and forms available, it is understandable 
that it would be difficult for the average instructor to select one instrument 
that he could use and have confidence in using. A partial solution to this 
problem is to: (a) survey student evaluation instruments currently in use, 
(b) select the best of these instruments, and (c) check the criterion validity 
of the selected instruinonts. 
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The literature review identified two approaches for developing student 
rating instruments: a rational approach and an empirical approach. The 
rational approach is similar to the approach used in the construction of an 
achievement instrument with items written in terms of a set of specifications. 
On the other hand, in the empirical approach, items are collected from a 
variety of sources, and principal component analysis, or some type of factor 
analyses, is then used to categorize the items. Most researchers apparently 
stress the empirical approach, but there is no evidence to show which is the 
better approach or to what extent a combination of these two approaches is 
possible or advantageous* Whether one set of scores yields a better prediction 
of achievement than another should be of concern in instrument development. 
A dependable answer to this question might suggest future approaches to con- 
struction of instruments of students* asse-iments of college instruction. 

OBJECTIVES OF THE INQUIRY 

The overall purpose of the study was to compare two types of student 
response inventories for appraising college instruction. A major aspect of 
the comparison of the two instru^nts involved criterion validity checks. 
In the criterion validity checks, a major goal was to determine whether scores 
based on components or scores based on rational sections were better predictors 
of end-of -course achievement. 

The specific purposes of this study were to: 

1. Identify instruments currently being used for student evaluation of 
college instruction. 

2. Develop a set of criteria to be used in selecting instruments for 
possible use in the study. 
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3. Select two instruments for use In the research— one Instrument deve- 
loped rationally and the other Instrument developed empirically. 

4. Administer the two instruments to an available pool of classes. 

5. Analyze the responses to the two instruments by principal components 
analyses. 

6. Readminister the two instruments to classes that had a common end- 
of-ccurse examination. 

7. Use self -reported grade point averages (GPAs) together with mean raw 
scores based on: (a) the rationally defined categories of the first 
instrument, (b) the empirically derived categories of the first instru- 
ment obtained by the principal components analysis, and (c) the 
categories of the second instrument obtained by the principal com- 
ponents analysis, to predict students* end-*of -course achievement. 

8. Report and summarize the comparisons of the two instruments. 

9* Make recommendations (or suggestions) on the basis of these com-* 
parisons. 

SELECTION OF INSTRUMENTS 
A comprehensive search of the literature in the field was undertaken to 
Identify Instrimients currently being used for student evaluation of college 
instruction. Sources Included ERIC (1970-1973), Buros' Mental Measurements 
Yearbooks , Buro ^ Tests in Print. , relevant papers presented at the American 
Educational Research Association and National Council on Measurement in Edu- 
cation annual meetings, and other appropriate bibliographic sources. Programs 
of these annual meetings were examined for all topics concerned with student 
appraisal of college instruction and requests for these papers were made by mail. 
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Thirty-nine Instruments for appraising college Instruction were located 
through the search of the literature. To be Included In this list, an Instru- 
ment had to he applicable to any acac mlc area, designed to evaluate college 
teaching, and provide Information to be used in the Improvement of instruction. 
In order to reduce the number of Instruments, a list of criteria to be used in 
evaluating the Instruments was developed I the present writer. Feedback on 
these criteria was obtained from graduate tudents, professors, and students 
in a graduate seminar irs research. The ll; was revised and the final list 
of criteria is as follows: 

CRITERIA FOR FIRST SELECTION OF AN INSTRUMENT 

1. The instrument was designed to evaluate any college level course in 
an academic classroom setting. 

2. An implied or stated purpose of the instrument is to provide specific 
information to the instructor for use in improving teaching. 

3. Data on the instrument are available in publications and/or from 
papers presented at national meetings of scholarly organizations. 

4. The instrument is available for purchase or may be reproduced by 
obtaining permission from the author. 

5. The instrument is one that is not unreasonable in terms of time and 
effort for administration. 

6. Items in the instruments were cither selected inductively using res- 
ponses from groups comparable to one for which the instrument is 
intended or items were selected on the basis of clearly described 
rationale. 

7. Reliability information has been reported. 

- 6 
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8. Validity Information, in addition to content validity, has been 
reported. 

The properties of each of the thirty-nine Instrucients were then examined to 
determine which of the instruments met all of the criteria. 

The Inve ntory of Student Perceptions of Instruction (ISPI) by Scott (1973) 
was the only instrument identified that haa the content developed rationally 
rather than empirically and that at the same time satisfied all of the set of 
predeternined criteria. Most ISPI items are descriptive rather than evaluative 
and cover most significant aspects of instruction. When compared with other 
student evaluation of college instruction Instruments, ISPI is as comprehensive 
as other available Instruments. 

From the instruments that met all criteria, two instruments with empiri- 
cally developed content were selected. These instruments were those that 
were widely used and widely reported in the literature. Four judges then 
selected one of the two instruments on the bas^s of the list of criteria and 
on the basis of the Instrument that they would choose to administer in their 
classes. An agreement of three of the four Judges constituted the basis of 
selection of the St:udent Instructional Report (SIR) by Centra (1972) as the 
second instrument to be used in the study. 

These two instruments (ISPI and SIR) selected for the study were the two, 
then, that best exemplified the rational and the empirical approaches to 
developing such instrimients. 

METHODS 

In the winter quarter of 1974, the two Instruments were administered to 
554 students in 30 classes at the University of Georgia and Brenau College. 
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The Instructors were told that the purpose for obtaining the student ratings 
In their classes was to analyze the responses to the two Instruments uslug 
principal components. They were assured that the purpose was not to compare 
their teaching effectiveness with other Instructors and that no one would know 
their Identity. These Instructors were told that they could obtain results of 
their ratings from the investigator. 

Methods suggested by several x^ltert — Scott (1973); Costln, Greenough, 
and Mengcs (1971), and Eble (1971) — were considered and were Incorporated In 
the following list of procedures lor administration of the two forms: 

1. The forms were administered during the last week of classes. 

2. The forms were randomly distributed with one half of each class re- 
ceiving ISFI and the other half of each class receiving SIR. 

3. Students responding to ISFI marked all 69 Items and students res- 
ponding to SIR marked 31 Items (8 items were omitted from SIR since 
they are largely student descriptive information). 

4. Students were assured that their identity would not be disclosed and 
that thei.r participation would not affect their grades in any way. 
They were told that the Instructors would not' know the results until 
final grades had ..n posted. 

5. Students were told that the ratings would give their instructors an 
opportunity to learn about the effectiveness of their teaching tech- 
nr'ques and to make appropriate adjustments. 

6. Each instructor was asked to leave the classroom while the senior 
author had the students fill out the ratings. 
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Mean responses to the Items on the two Instruments were then analyzed by 
principal components ':^lth varlmax rotation. In advance of the principal com- 
ponents analyses. It was determined that Items with primary loadings less than 
•40 and Items loading high on more than one principal component (difference of 
the absolute values of the highest loadings had to be greater than .10) would 
be eliminated from the study. It was expected that the elimination of Items 
with high loadings on more than one principal component would essentially iden- 
tify principal components that were uncorrelated and thus yield higher multiple 
correlations la the prediction of final examination scores. Principal com- 
ponents obtained were used in the second phase of the study. 

The following quarter, the two instruments were administered at the Uni- 
versity of Georgia to 525 students in 31 freshman English classes that had a 
common end-of-quarter examination. Again a random half of each class was 
given one instrument and the other half, the second instrument. Purposes of 
the study were explained and the Instructors were assured that if they parti- 
cipated in the study no one would know their identity. They were also told 
that results of the ratings would be made available to them. 

In this administration, forms were attached to the answer sheets, and 
students were asked to supply their names, their identification numbers (IDs), 
their cumulative grade point averages (CPAs), and number of quarters they had 
attended the University of Georgia. They were told that the information on 
this form was for research purposes only and that in no way would they be 
identified. Other procedures were similar to those of the previous quarter 
with the except:>.on that data were collected during the last two weeks of the 
quarter rather during the last week. 
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Rayder (1968) reported that students remembered and accurately reported 
their Gi^As (correlation was .96 for 100 randomly selected students). To deter- 
mine if the students in the fre&noan English classes were accurately reporting 
their GPAs> two students were randomly selected from each class. These 62 
CPAs were checked with the official records. Official CPAs were then correlated 
with reported CPAs. Also an F-test and a t-test were used to dotermlne if 
there were significant differences in population variances or means at the .10 
level of significance. 

An attempt was made by the investigator to increase the reliability of 
the scoring of the final examinations. Each instructor was given a list of re- 
commendations for scoring essay examinations as proposed by Thomdike and 
Hagen (1969). 

Two days before the final examination, each instructor was given a list of 
the names of the students in his class who completed the evaluation forms. In- 
structors wrote the final examination grades of their students on the list and 
returned it to the investigators by campus mail. 

The final examination given to freshman English classes was an essay 
examinatioa common to all classes. All students tcck the examination at the 
same time. Questions on the examination were chosen by a committee of three 
instructors of freshman English. Questions were submitted to this committee 
for their consideration by instructors teaching the freshman English class. 
Each instructor graded the papers from his class or classes. The instructors 
graded on a scale from F to A, using plus and minus signs. For the purpose 
of analyses, grades on the examination vzere converted to a 14-point scale 
(F=l to A+«14). 
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One-way analyses of variance were ub^r^d to determine if there were signi- 
ficant dlf fere ices among the class means on the final examination. Separate 
analyses were used t<v the students responding to SIR and those responding to 
ISPI. 

Three multivariate analyses of variance (MANOVAs) were used to determine 
if the vectors of the scores based on mean responses to the sections were sig- 
nificantly different amonp Instructors. Since no computer program was available 
to handle 31 classes, 12 classes were randomly selected for the analyses. 
Hunmiel and Sllgo (1971) reported empirical data that suggest that it is reason- 
able to follow up one-way MANOVAs with univariate analyses of variance (ANOVAs). 
To determine if there were significant differences among the Instructors on 
each of the six rational sections of ISPI, the empirical sections of ISPI, and 
empirical sections of SIR for Che 31 classes, ANOVAs were used. The level of 
significance fer all MANOVAs and ANOVAs was set at .05. 

Step-wise multiple correlational analyses were then carried out using the 
self -reported grade point averages (CPAs) together with mean responses to the 
empirical sections of the two Instruments (obtained by the principal components) 
and to the rational sections of ISPI to predict mean end-of -course achievement 
scores. Since it seemed reasonable to assume that multiple correlation coeffi- 
cients (Rs) based on clast; means would be more stable than Rs based on indivi- 
dual scores, .10 was set as the level of sigP'^ficance. 

RESULTS OF DATA Al^ALYSES 
After computing class means for each of the items on ISPI and SIR, a 
principal components with varlmax rotation was used to determine the component 
loadings of the items. The six component solution to ISPI accounted for 80% 
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of the variance: hox^ever, one component contained only one Item. Since one- 
Item components are not generally stable » five components \vere then rotated. 
These five components accounted for 76% of the variance. Thirteen Items had 
high loadings on two or more components and one Item had loadings of less than 
•40 on each of the five components. These 14 Items were eliminated from the 
further analyses. 

The six component solution of SIR accounted for 73% of the variance. 
Three Items were eliminated from further analyses since they had high loadings 
on more than one coiuponent 

The varlmax solution and the items which had significant loadings on each 
component are presented in Tables 1 and 2. Names assigned to the components 
of ISPI were: ''Locus of Decision Making," ^'Course Relevance and Value," 
"Feelings of Acceptance or Tens5.on," "Content Meanint>f ulness ," and "Scope of 
Instructor Objectives." The six components of SIR were entitled: "Instructor' 
Planning and Learning Climate;" "Adjustment to Individual Student Needs;" 
"Work Load;^' "Relevance of Methods end Materials;" "Texts, Tests and Student 
Interest;" and "Global Appraisals." These names are by no means definitive; 
they are only suggestive of the gist of the majority of items in that section. 
The components obtained using the class mean responses were used in the second 
phase of the study to determine criterion validity information. 

CPAs were needed in the second phace of the study. To determl' if the 
students were accurately reporting their CPAs, two students were randomly se- 
lected from each class, and their reported CPAs were checked against official 
records. The correlation of the official CPAs with reported CPAs was •94. 
This correlation was significant at the .01 level. The test for difference 
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In population means produced a t of .54, and the F-test for equality of the 
population variances was 1.16. Both of these results were non-slgnif leant at 
the .10 level. Results supported the hypotheses of no differences In the popu- 
lation means or the population variances of the two .croups. Results, then 
supported the use of the self-reported CPAs as a predictor variable. 

One-way analyses of variance were used to determine If therc:^ were signifi- 
cant differences among the class means on the final examination grades reported 
by the Instructors. The obtained F-value for students responding to ISPI was 
1.96, and the obtained F^value for students responding to SIR was 2.30. Both 
F-values were significant at the .05 level. Therefore, use of class mean scores 
on the final examination was supported. Three MANOVAs were used to determine 
if the vector scores based on mean responses to the sections were significantly 
different among Instructors. The data are based on twelve randomly selected 
classes from the 31 classes. The likelihood ratio test statistics, chi-squares, 
for the instrxunents were as follows: 119.4 for the rational sections of ISPI, 
122.5 for the empirical sections of ISPI, and 122.4 for the empirical sections 
of SIR. All of these were significant at the .05 level. Since the twelve 
classes were randomly selected, it can be assumed that similar results would 
have beer obtained using all 31 classes. Results supported the use of class 
mean responses for the sections as the predictors. 

Since results of the MANOVAs vere significant, ANOVAs were used as follow 
ups. All 31 classes were used in the anlyses. At the .05 level of signifi- 
cance, follow-up ANOVAs revealed significant differences among average ratings 
for instructors for all rational sections of ISPI, all empirical sections of 
ISPI, and four of the six empirical sections of SIR. The F-values for section 
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3 of SIR— "Work Load"— and of 1.38 for section 4~"Relevance of Methods and 
Materials" — were not significant* 

The class mean responses to each of the rational sections of ISPI, the 
empirical sections of ISPI, and the empirical sections of SIR (from Tables 3, 
4, and 5) and class mean self -reported CPAs were then used to predict the 
class mean final examination scores In step-wise multiple correlation analyses 
(Kerllnger and Pedhazur, 1973). The correlation matrices for class mean sec- 
tion ratings, self-reported CPAs, and the final examination scores are pre- 
sented In Tables 6, 7, and 8. At the .05 level, significant correlations 
existed between all mean section ratings. No significant correlations at the 
.05 level existed between the mean final examination scores and the mean 
section ratings. 

In the first step-wise regression analyses, self-reported CPAs and six 
ISPI rational section predictor variables were entered. The multlple-R ob- 
tained using the CPAs and the six sections to predict final examination 
performance was .37; neither this value nor any of the other multlple-Rs was 
significant at the .10 level. Only four of the six ISPI empirical predictor 
variables together with self-reported CPAs were entered in the second step- 
wise regression. The largest multiple-R obtained was .42. Again, there was 
no empirical section of ISPI or combination of sections with self-reported 
GPA that contributed significantly to mean final examination scores of the 
freshman English classes. 

A sunimary of the step-wise regression analysis for the SIR empirical 

sections and self-reported CPAs to predict class mean examination scores is 

2 

provided in Table 9. R s (squared mulniple-Rs) are also listed. These in- 
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dlcate the proportion of variance that can be predicted from the predictor 
variables. Self -report ad GPA and all six empirical sections of SIR were en- 
tered as predictor variables. Results of F-values to Remove revealed that 
In this study mean self -reported CPAs and two empirical sections of SIR 
(labeled "Adjustment to Individual Needs" and "Work Load") were statistically 
significant predictors of class mean examination performance. The multiple 
correlation obtained using the self-reported CPAs and the sections as pre- 
dictors was .62. The proportion of variance accounted for by using these 
three predictors was .39. 

SUMMARY OF CONCLUSIONS 
The following conclusions were drawn from the data analyses: 

1. Large amounts of variance were accounted for by using class mean res- 
ponses to items as the units of analyses for both ISPI and SIR. A six-component 
solution of SIR accounted for 73% of the variance, and a five-component solution 
to ISPI accounted for 76% of the variance. 

2. At the .05 level of significance, results of MANOVAS (based on twelve 
randomly selected classes) revealed that the vector scores based on the mean 
responses to the sections were significantly different among English instructors. 
At the .05 level of significance, follow-up ANOVAs revealed rlgnif leant differ- 
ences among average ratings for instructors for all rational sections of ISPI, 
all empirical sections of ISPI, and four of the six empirical sections of SIR. 

3. For a stratified random sample of 62 students (2 from each of the 31 
classes) , tests for differences in actual and self-reported GPA means and 
variances were non-sijp;nif leant (.10 significance level). 
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4, The results of multiple correlational analyses revealed that none of 
the mean eiiq>lrlcal section scores or of the mean rational section scores of 
ISPI was a significant predictor of end-of -course achievement. 

5. At the .10 level of significance, results of the multiple correlational 
analysis revealed a statistically significant multiple correlation of ,62 when 
mean self-reported CPAs and two empirical sections of SIR (labeled "Adjustment 
to Individual Student Needs" and "Work Load") were used to predict class mean 
end-of-course achievement. 

IMPLICATIONS 

Vkdile it is reasonable to believe that similar results would be obtained 
if the study were replicated in classes comparable to the freshman English 
classes of this study, generalizability to such classes and populations should 
be m^ide with caution. Conce' «bly, different results could be obtained using 
different types of courses, Q:.^ierent types of achievement er ^minations, and 
principal component scores rather than scores based on principal components. 
Taking these precautions into account, the results seem to have certain impli- 
cations for the use, interpretation, and development of student -evaluation-of- 
college-instruction instruments. These implications are stated below: 

1. Results of this study suggest that student appraisal of college in- 
struction using SIR in conjunction with self-reported CPAs are of some help 
in predicting end-or-course final examination scores. Also examined from a 
practical viex^oint, the results of this study suggest careful examination of 
whatever instrument is used. If the effectiveness of an instructor is measured 
in terms of end-of-course achievement of his class, then college administrators 
should proceed with caution in using student-evaluation-of-college instruction 
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instruments to g?v ..^e instructor effectiveness, 

2* Moreover, results of this study lend some support to the use of 
instruments developed empirically over those developed rationally. While all 
empirical sections of ISPI, all rational sections of ISPI, and four of the six 
empirical sections of SIR revealed significant differences in the ratings of 
the instructors on the sections, only two sections of SIR, together with self- 
reported CPAs bore a significant relationship to end-of-course final examinaticn 
scores. 

DISCUSSION 

There are certain problems inherent in the design of this study that may 
have influenced this lack of relationship between student ratings and final 
examination scores. One problem involved the lack of anonymity of the ratings. 
While writers have refered to the necessity of anonymous ratings, it was neces- 
sary to have the students in this study identify themselves. This lack of 
anonymity may have affected the results; students may have responded differently 
if they had not had to suppl their IDs. 

Another factor that may have influenced the lack of relationship between 
ratings and achievement was the use of scores based on principal components 
rather than principal component scores. One reason for using scores based on 
principal components was that these scores are scores that Instructors are 
familiar with. However, these section scores turned out to be highly inter- 
correlated but not significantly correlated with class mean achievement* Tables 
6, 7, and 8 also indicate that the sections of SIR were not as highly inter- 
correlated as the rational and empirical sections of ISPI. Of the 15 inter- 
section correlations of SIR, five were less than .50 and only one was greater 
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than .80. With respect to ISPI rational sections > of the 15 Inter-sectlon 
correlations, nine were .80 or above and none were less than .60. Of the 10 
Inter-sectlon correlations of ISPI empirical sections, two were .80 cr above 
and only one was less than .60. These results could explain why the sections 
of SIR were better predictors of mean examination scores than the sections 
of ISPI. While principal component scores would have yielded components that 
were basically uncorrelated, the question remains as to whether they would 
have been significantly correlated with end-of -course achievement. 

Another problem concerns the random halves of the English classes. The 
lack of relationship between ISPI sections and final examination performance 
could be attributed to the low correlation between the class mean self-reported 
GPA and the class mean score on the final examination. This correlation was 
only .09 (see Tables 7 and 8); whereas the same correlation for the random 
half of students responding tc SIR was .36 (see Table 9). Although halves of 
classes were randomly chosen, these results indicate that the samples were not 
similar with respect to CPAs and final examination performance. 

As has been referred to previously, one possible problem Involved the 
essay examination. It may have been that the grades on the examination did 
not truly reflect achievement in the course. 
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Table 1 

Components and Component Loadings (Varlmax Rotation) for ISPI 
Using Class Mean Responses to Indlvldtxal Items 
(n«30 Classes) 



Factor 
Loading 



Factor I: Locus of Decision Makln*> 

23 The class has a "voice" In deciding jAiat we do. .87 

18 In the class we try to understand points of view 

that differ from our own. .85 

27 The Instructor tries to get more students to 
participate In making decisions idilch affect the 
class. 

28 The class has a "voice" In deciding what sequence 

we take up Ideas, topics, and problems. .81 

25 The class has no "voice" in setting up acceptable 
standards for academic performance. -.78 

26 When problems arise, the class has a "voice" In 
working out solutions. .78 

24 The class has a "voice" In deciding how we do what 

Is done. ^78 

52 Instead of expecting every student to do the same 
thing, the Instructor provides dlffereut activities 
for different students. .73 

63 Our class and the Instructor look carefully at what 
we are learning and decide whether It Is worth the 
time and effort we are spending on It. .73 

47 The class, with the instructor's help, selects a 
problem or area of Interest to work on and then 
breaks it down to find out just what we want to 
learn and how to go about It. .71 

10 In this class we learn to express our ideas in 
ways which won't hurt other people's feelings or 
make them angry. .70 



21 



Table 1 (Continued) 



48 We Identify and xiork on our problems In communicating — 

with other students and with the Instructor. .70 

65 My grade depends primarily upon my improvement over 

my past performance, .69 

11 Through the way we Interact In class we apply demo- 
cratic values, ^68 



17 In this class each student Is accepted on his own 
merits. 



.66 



60 My grade Is Influenced by what Is best for me as a 

person as well as by how much I have learned. .64 

20 What we do In class helps me understand myself better. .63 

29 The Instructor gets help from resource persons when 

they can contribute to what the class Is doing. .63 

12 In expressing Ideas we learn to control our feelings. .61 

15 Our Instructor encourages us to express different 
opinions and differing points of view on the Ideas 
we discuss. go 

21 The Instructor Is Interested In me as a person. .56 
Factor II; Course Relevance and Value 

46 IJIiat we learn Is directly related to tha work I plan 

to do when I graduate. -.89 

1 What we study does not help me plan my career. .88 

41 I try hard In this class because, to me, what I am 

trying to learn Is worthwhile. -..87 

40 The class considers that what v;e are learning Is worth 

learning. --.11 

42 Our assignments are uninteresting and are of little or 
no value. 

8 I'That we learn in Impractical and of no use outside of 

class. g5 
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Table 1 (Continued) 



38 Because It Is Interesting, I do additional work out- 
side of class that Is not required. -.60 

51 By the time I have finished an activity or block of 
work, the things I've learned fit together to form 
a pattern that makes sense to me. -.57 

5 The Instructor plans activities which apply what we 
have learned to situations that I might encounter 
later on In my vocation. -.55 

Factor III; Fe elings of Acceptance or Tension 

13 The atmosphere In this class Is unfriendly. .86 

19 The Instructor tries to force us to accept his Ideas 

and Interpretations. ^72 

66 This Instructor Is the kind I admire and respect. -.71 

9 The Instructor would rather have me think through 

something than memorize It. -.68 

62 This Instructor's grading Is fair. -.68 

16 This class makes me nervous. .65 

58 The way In which the Instructor organizes Ideas and 

activities Is confusing. .61 

44 Instruction Is planned In terms of thr* textbook se- 
quence of content. 57 

Factor IV: Content Meanln5>fulpess 

32 Wiian appropriate, we construct or devise our own 

Instructional materials. -.74 

39 The content of this course Is too difficult. .72 

49 The Instructor's lectures and oral presentations 
are "over my head." 

50 The Instructor does not speak clearly. .70 
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Table 1 (Continued) 



54 In moving from one Idea to another, the Instructor 

makes the connection clear. -,69 

64 My grade depends primarily on how well I do compared 

with the rest of the class. .68 

55 Our Instructor explains things very clearly. -.68 

53 At the beginning of a topic or project I understand 

clearly what I am supposed to go about learning, -.65 

37 We have opportunities to carry out original assignments 

and projects. -.64 

35 We participate in a variety of class activities in 

addition to talking and listening. -.64 

2 In this class I developed skills and knowledge 

directly related to my plans after I finish college. -.61 

Factor V; Scope of Instruction Objectives 

6 We learn to listen carefully to what other people 
say and to separate statements of fact from state- 
ments of opinion or attitude. ^75 

4 We learn to express our ideas more precisely. .71 

57 At the end of an activity, unit or assignment, we 

summarize what we have learned. ^65 

7 We learn such skills as identifying assumptions, 
reasoning logically from assumptions and testing 
conclusions. 

69 The Instructor has a thorough knowledge of the 
subject matter. 

14 Class activities are planned so that every student 

who wishes to may make a contribution. .60 
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Table 2 

Components and Component Loadings for SIR 
Using Class Mean Responses to Individual Items 
(n«30 Classes) 



Factor 
Lccdlng 



Factor I: Instruc tor's Planning and Learning Climate 

3 The Instructor used class time well, ,89 

20 In my opinion, the Instructor has accomplished (Is 

accomplishing) his objectives. .86 

10 The Instructor raised challenging questions or pro- 
blems for discussion. ^33 

1 The Instructor's objectives for the course have been 
made clear. 

38 I would rate the overall value of class discussions... .75 

8 The Instructor seemed genuinely concerned with 

students' progress and was actively helpful. .70 

7 The Instructor encouraged students to think for 

themselves. gg 

14 The Instructor summarized or emphasized major points 

In lectures or discussions. ^59 

39 Compared to other Instructors you have had (secondary 
school and college), how effective has the Instructor 
been In this course: 

12 The Instructor was well-prepared for each class. .66 

11 In this class I felt free to ask questions or express 

my opinions. ^gj^ 

34 Overall, I would rate the quality of the exams... .61 

Factor II: Adjustment to Individual Student Needs 

23 For me, the pace at which the Instructor covered the 

material during the term was... ^84 
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Table 2 (Continued) 



16 The scope of the course has been too limited; not 
enough material has been covered. 

21 For my preparation and ability, the level of diffi- 
culty of this course was... 

19 The Instructor was open to other viewpoints. 



Factor III; Work Load 

5 The instructor seemed to know when students didn't 
understand the material. 

18 I have been putting a good deal of effort into this 
course. 

22 The work load for this course in relation to other 
courses of equal credit was... 



Factor IV: Relevance of Methods and Materials 

17 Examinations reflected the important aspects of the 
course. 

6 Lectures were too repetitive of what was in the 
textbook(s) . 

9 The instructor made helpful comments on papers or 
exams. 



Factor V: Texts, Tests and Student Interest 

32 Overall, I would rate the textbook(s) . • . 

15 My interest in the subject area has been stimulated 
by this course. 

13 The instructor told students how they would be 
evaluated in the course. 
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Table 2 (Continued) 



Factor VI; Global Appraisals 

35 I would rate the general quality of the lectures,. • 

36 I would rate the overall value of class discussions,. 

24 To what extent did the instructor use examples or 
illustrations to help clarify the material? 
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Table 5 

correlation Matrix for Mean iSp^ ^tio^^^ Section Scores, 



Self^ 



^^ported GPAa^ Final Exainioa<=^°'^ Scored ^1 Clas^®^ in Freshman Englieh 



Final 



GPA 



Final Exam 





1.00 73* 


.63* 


.80* 


.19* 


• 69* 


-.14 


.18 


a 


1.00 


• 80* 


.83* 


.80* 


'73* 


-.22 


.19 


a 




1.00 


.85* 


.31* 


• 72* 


-.30 


.17 








1.00 


.88* 


• 80* 


-.16 


.14 


5 








1.00 


.87* 


-.28 


.11 


6 










I. Do 


-.1' 


.01 














l.i 


09 



am 



1.00 



* Significant at .05 level 

^^ction l-~lnatructional Objectives 

^^Otion 2— Kum^jj Relations 

^^«itlon 3— Use of Instructional Besoutc 

^^«ition ^tivation 

^^«ition 5— Meaningfulness of content 

^^«ition 6—^^eaaureinent and Evaluation 



34 



Table 7 

Correlation Matrix for Mean ISPI Empirical Section Scores, Self- 
Reported CPAs, and Final Examination Scores for 31 Classes in Freshman English 



Section 



CPA 



Final Exam 



1 
2 
3 
4 
5 
CPA 
Final Exam 



1.00 .81* 
1.00 



.67* 


.80* 


.70* 


-.29 


.10 


.56* 


.79* 


.73* 


-.24 


-.02 


1.00 


.71* 


.79* 


-.14 


.29 




1.00 


.75* 


-.28 


.19 






1.00 


-.15 
1.00 


.16 
.09 
1.00 



* Significant at ,05 level 

Section 1 — Locus of Decision Making 
Section 2 — Course Relevance and Value 
Section 3 — Feelings of Acceptance or Tension 
Section 4 — Content Meaningfulness 
Section 5 — Scope of Instructor Objectives 
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Table 8 

Correlation Matrix for Mean SIR Empirical S^^^j^on Scores, Self- 
Reported CPAs, and Final Examination Scores of 31 ^X^^ees In Freshman English 



* Significant at .05 level 
Section 1 — Instructor's Planning and Learning CliinatQ 
Section 2 — Adjustment to Individual Student Needs 
Section 3 — Work Load 

Section 4 — Relevance of Methods and Materials 
Section 5— Texts, Tests and Student Interest 
Section 6 — Global Appraisals 



Section 


1 2 


3 


4 


5 


6 


GPA 


Final Exam 


1 


1.00 .66* 


.44* 


.71* 


.70* 


.90* 


-.29 


.11 


2 


1.00 


.52* 


61* 


AS* 


.61" 




. 


3 




1.00 


.42* 


.41* 


.43* 


-.27 


-.18 


4 






1.00 


.53* 


.61* 


-.18 


.04 


5 








1.00 


.67* 


-.14 


.17 


6 










3..00 


-.26 


.22 


GPA 












1.00 


.36* 


Final Exam 














1.00 
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Siimmary of Step-wise Regression Analysis 
SIR Empirical Sections and Self-Reported CPAs Predicting 
Mean Final Examination Scores in 31 Classes in Freshman English 



Step 


Predictor 

Variable 

Entered 


Multiple R 


2 

R 


F to Remove 


1 


GPA 


.36 


.13 


4.41* 


2 


Section 2 


.54 


.29 


6.40* 


3 


Section 3 


.62 


.39 


4.05* 


4 


Section 6 


.64 


.41 


1.21 


5 


Section 1 


.67 


.45 


1.86 


6 


Section 4 


.68 


.47 


.61 


7 


Section 5 


.69 


.48 


.61 




Significant at 


.10 level 






Section 


1 — Instructor's 


Planning and Learning Climate 




Section 


2 — Adjustment to Individual Student Needs 




Section 


3 — Work Load 








Section 


4 — Relevance of 


Methods and Materials 






Section 


5 — Texts, Tests 


and Student Interest 







Section 6 — Global Appraisals 
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